The online evaluation of speech synthesis using eye movements
نویسندگان
چکیده
This paper describes an eye tracking experiment to study the processing of diphone synthesis, unit selection synthesis, and human speech taking segmental and suprasegmental speech quality into account. The results showed that both factors influenced the processing of human and synthetic speech, and confirmed that eye tracking is a promising albeit time consuming research method to evaluate synthetic speech.
منابع مشابه
Using eye movements for online evaluation of speech synthesis
This paper describes an eye tracking experiment to study the processing of diphone synthesis, unit selection synthesis, and human speech taking segmental and suprasegmental speech quality into account. The results showed that both factors influenced the processing of human and synthetic speech, and confirmed that eye tracking is a promising albeit time consuming research method to evaluate synt...
متن کاملEye Movements in Speech Technologies: an overview of current research
We present a summary overview of recent work using eye movement data to improve speech technologies. We summarize the experimental psycholinguistic evidence motivating these applications and provide an overview of a number of gaze-speech studies in the areas of multimodal human-computer interaction, synthesized speech evaluation and automatic speech recognition.
متن کاملEye tracking for the online evaluation of prosody in speech synthesis: not so fast!
This paper presents an eye-tracking experiment comparing the processing of different accent patterns in unit selection synthesis and human speech. The synthetic speech results failed to replicate the facilitative effect of contextually appropriate accent patterns found with human speech, while producing a more robust intonational garden-path effect with contextually inappropriate patterns, both...
متن کاملApplication of eye tracking technology for screening and rehabilitation of children with special needs.
Eye tracking is a technology for measuring eye movements when looking at a point. The length of time to look at a particular situation, the sequence of observations, as well as points of attention are processed in the process of eye tracking and eye movements are identified by topics such as fixation, saccade, etc. Information about how the eyes move at a special moment has many potential appli...
متن کاملIncremental Referential Domain Circumscription during Processing of Natural and Synthesized Speech
We present experimental evidence from a study in which we monitor eye movements as people respond to pre-recorded instructions generated by a human speaker and by two text-tospeech synthesizers. We replicate findings demonstrating that people process spoken language incrementally, making partial commitments as the instruction unfolds. Specifically, they establish different referential domains o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007